OBJECT-ORIENTED DATA TRANSFER SYSTEM FOR DATA SHARING 



Field of the Invention 

The present invention relates generally to data transfer systems and more particularly 
to object-oriented data transfer methods and systems for transferring data from a data source 
to multiple data sink objects. 



Background of the Invention 



In computer systems, some application software tools enable computer users to 
analyze or process the data acquired from data acquisition devices, such as cameras and 
scanners. The application software tools may also enable the computer users to send the 
analyzed or processed data to output devices coupled to the computer systems, so that the 
computer users can obtain the analyzed or processed data. MATLAB, from The MathWorks, 
Inc. of Natick, Massachusetts, is one of the application software tools that provides an 
integrated mathematical computing and visualization environment for technical computing. 
The computer systems, which run the application software tools, such as MATLAB, need data 
transfer systems for transferring the data acquired from the data acquisition devices to the 
application software tools that analyze and process the data. The computer systems may also 
need data transfer systems that transfer the analyzed or processed data to the output devices or 
other application software tools. Image Acquisition Toolbox, from The MathWorks, Inc. of 
Natick, Massachusetts, provides a set of software tools for acquiring data from data 
acquisition devices and transferring the data to application software tools or output devices. 

In conventional data transfer systems, extraneous copies of data are made to transfer 
the data to each of the application software tools or output devices. The extraneous copies of 
the data make it impractical, and in some cases impossible, for users to allocate sufficient 
memory space in computer systems to contain all of the copies of the data. Furthermore, the 
conventional data transfer systems store the data that is no longer used by the application 
software tools or output devices in the memory of the computer systems, which results in the 
reduction of the memory space available in the computer systems. Therefore, there is a need 
for data transfer systems in which the data acquired from data acquisition devices is 
transferred to each of the application software tools or output devices without making 
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extraneous copies of the data. That is, the data acquired from the data acquisition devices 
needs to be shared by the application software tools or output devices. There is also a need 
for data transfer systems in which the data that is no longer used by the application software 
tools or output devices is removed from the memory in the computer systems. 



Summary of the Invention 

The present invention provides methods and systems for transferring data from a data 
source to multiple data sink objects in computer systems. The present invention provides 
object-oriented data transfer methods and systems in which the data acquired from the data 
source is encapsulated into a data object. The data object is shared by the multiple data sink 
objects which manipulate, display, analyze or process the data associated with the data object. 
The data object shared by the multiple data sink objects prevents extraneous copies of the data 
being transferred and thereby enhancing the memory space available in the computer systems. 
The present invention also provides object-oriented data transfer methods and systems in 
which a data object is automatically removed from the memory of computer systems when the 
data object is no longer used by data sink objects. The present invention provides a counter 
for the data object that contains information on whether the data object is used by the data 
sink objects. The data object is removed from the memory when the information of the 
counter indicates that the data object is no longer used by the data sink objects. Alternatively, 
the data object that is no longer used by the data sink objects may be stored in a separate 
memory location of the computer systems for a future use. 

In an illustrative embodiment of the present invention, a method is provided for 
transferring data from a data source to multiple data sink objects. The data is received from 
the data source and encapsulated into a data object in the memory of a computer system. The 
information identifying the data object is provided to the multiple data sink objects. The 
multiple data sink objects access the data associated with the data object using the 
identification information. 

In another illustrative embodiment of the present invention, a data transfer system is 
provided for transferring data from a data source to multiple data sink objects in a computer. 
The system includes an interface for communicating with the data source to receive the data 
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from the data source. The system also includes a data processor for encapsulating the data 
into a data object in the memory of a computer system. The data transfer system further 
includes a data server for providing to the multiple data sink objects identification information 
identifying the data object. The multiple data sink objects access the data encapsulated into 
the data object using the identification information. 

In still another illustrative embodiment of the present invention, a medium is provided 
for holding computer-executable instructions for a method in a computer system that receives 
data from a data source and transfers the data to data sink objects. The instructions 
communicate with the data source to receive the data from the data source and encapsulate the 
data into a data object in the memory of the computer system. The instructions include a data 
server object that provides the data sink objects with the information identifying the data 
object. The data sink objects access the data object using the identification information. 

By encapsulating data acquired from a data source into a data object and sharing the 
data object, the data transfer system of the present invention can prevent extraneous copies of 
the data provided to each of the data sink objects. Furthermore, the data transfer systems of 
the present invention remove from the memory of computer systems the data object that is no 
longer used by the data sink objects. As a result, the present invention enhances the efficiency 
of the memory usage in the computer systems. 

Brief Description of the Drawings 

The aforementioned features and advantages, and other features and aspects of the 
present invention, will become better understood with regard to the following description and 
accompanying drawings, wherein: 

FIGURE 1 is a block diagram representation of a data transfer system located between 
a data source and multiple data sink objects in the illustrative embodiment of the present 
invention; 

FIGURE 2 is a block diagram representation of exemplary software tools 
implementing the illustrative embodiment of the present invention depicted in FIGURE 1; 
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FIGURE 3 is a block diagram of an exemplary computer system suitable for practicing 
the illustrative embodiment of the present invention; 

FIGURE 4 is a block diagram representation illustrating in more detail the software 
tools depicted in FIGURE 2; 

FIGURE 5 is a block diagram representation illustrating in more detail the software 

tools depicted in FIGURE 4; 

FIGURE 6 is a block diagram representation of at least one data sink listener coupled 
to a data sink in the illustrative embodiment of the present invention; 

FIGURE 7 is a flow chart summarizing the exemplary operation of the adaptor layer in 
the illustrative embodiment of the present invention; 

FIGURE 8 is a flow chart showing the exemplary operation of the engine layer in the 
illustrative embodiment of the present invention; 

FIGURE 9 is a flow chart showing the exemplary operation of the counter of the data 
object in the illustrative embodiment of the present invention; and 

FIGURE 9a is a flow chart showing the operation of the illustrative embodiment of the 
present invention in connection with the data sink counter of the data object 540 described in 
FIGURE 9. 



Detailed Description 

The illustrative embodiment of the present invention concerns object-oriented data 
transfer systems for transferring data from a data source coupled to a computer system to a 
data sink object of application software tools in the computer systems. Although the 
illustrative embodiment of the present invention describes the data transfer system for 
transferring data from the device coupled to the computer systems to the application software 
tools, the present invention can apply to any data transfer systems including a data transfer 
system for transferring data from application software tools to devices coupled to the 
computer system, and a data transfer system for transferring data between application 
software tools. 

The illustrative embodiment of present invention encapsulates the data acquired from a 
data source into a data object. The information identifying the data object is provided to 
multiple data sink objects that express interest in the data acquired from the data source. Data 
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sink objects can access the data object with the identification information. The data object is 
shared by the multiple data sink objects which need the data to perform the functions of the 
data sink objects. The illustrative embodiment of present invention provides a counter for the 
data object that contains information on how many data sink objects are currently using the 
data object. The data object is removed from the memory of computer systems when the 
counter indicates that the data object is no longer used by the data sink objects. Alternatively, 
the data object that is no longer used by the data sink objects may be stored in a separate 
memory location of the computer systems for a future use. 

FIGURE 1 is a block diagram representation of a data transfer system 100 in the 
illustrative embodiment of the present invention. The data transfer system 100 includes a data 
source 1 10, data sink objects 150-190, a data object creator 120 and a data transfer unit 130 
located between the data source 1 10 and the data sink objects 150-190. The data transfer unit 
130 can be implemented separately from the data source 1 10 and the data sink objects 150- 
190, or in combination with the data sink objects 150-190. One of skill in the art will 
appreciate that the data transfer unit 130 can be implemented in combination with the data 
source and/or data sink in other embodiments of the present invention. 

The data source 1 10 is one of the terminals in the data transfer system 100. The data 
source 1 10 may include data acquisition systems, such as cameras, scanners, radars, etc. One 
of skill in the art will appreciate that the data source 1 10 is not limited to the data acquisition 
systems and rather includes any systems that originate data. For example, data sources may 
include network data sources including Internet data sources. In other embodiment of the 
present invention, such as in the data transfer system for transferring data from an application 
software tool in a computer system, the application software tool may be a data source. The 
data acquired from the data source 1 10 includes a single data or a sequence of data. The data 
may be a large sequence of textual or binary data, such as image data, continuously provided 
for a period of time. The data may also be packaged in logical datasets, such as frames of 
image data, video streams and scans of radar data, each of which can be utilized 
independently of other datasets. One of skill in the art will appreciate that the data acquired 
from the data source 1 10 is not limited to the format mentioned above and rather includes any 
other format of data. One of skill in the art will also appreciate that the data acquired from the 
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data source 1 10 is not limited to the image data and rather includes any other data, such as 
financial data and multimedia data. 



The data sink objects 150-190 are the other terminal of the data transfer system 100. 
The data sink objects 1 50-190 receive data from the data source 110 through the data transfer 
unit 130. The data sink objects 150-190 are application software tools that manipulate, 
visualize, process or analyze the data. The data sink objects 150-190 may receive and operate 
on the data at different streaming rates. One of skill in the art will appreciate that the data 
sink is not limited to application software tools and rather includes any systems that receive 
data in the data transfer system 100. In other embodiments of the present invention, such as a 
data transfer system for transferring data to devices coupled to the computer, the devices 
coupled to the computer can be data sink objects. 

The data source 110 invokes the methods of the data object creator 120 that creates 
and destructs various types of data object. After the data source 1 10 encapsulates the data into 
a data object, the data transfer unit 130 receives information identifying the data object from 
the data source 110. The data transfer unit 130 provides to the data sink objects 150-190 the 
information identifying the data object. The sink objects 150-190 access and share the data 
object using the identification information. One of skill in the art will appreciate that in an 
alternative embodiment of the present invention, the data transfer unit 130 may receive the 
data from the data source 1 10 and invoke the methods of the data object creator 120 to 
encapsulate the data received from the data source 1 10 into a data object. 

The data object is provided with a counter that contains information on whether the 
data object is used by the data sink objects 1 50-190 and how many data sink objects 1 50-190 
use the data object. The data transfer unit 130 automatically removes the data object from the 
memory of a computer system when the counter indicates that the data object is no longer 
used by the data sink objects 150-190. Alternatively, the data object that is no longer used by 
the data sink objects 150-190 may be stored in a separate memory location of the computer 
system for a future use. 
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FIGURE 2 is a block diagram representation of exemplary software tools 270 
implementing the data transfer system 100 in the illustrative embodiment of the present 
invention depicted in FIGURE 1. The software tools 270 include MATLAB 250 and Image 
Acquisition Toolbox 230, both from The MathWorks, Inc. of Natick, Massachusetts. 
MATLAB 250 includes a technical computing environment that provides core mathematics 
and advanced graphical tools for data analysis, visualization, and algorithm and application 
development. The computing environment in MATLAB 250 provides the mathematical, 
statistical, and engineering functions to satisfy engineers' and scientists' technical computing 
needs. 

The Image Acquisition Toolbox 230 is based on the MATLAB 250 environment, 
which provides a single, integrated environment to support the data acquisition from a data 
source 1 10 and the analysis of the data acquired from the data source 110. The software tools 
270 are seamlessly combined to receive data from the data source 1 10, and to analyze, 
process, and visualize the data, and save the data for post-processing. The Image Acquisition 
Toolbox 230 provides a set of tools for acquiring data from the data source 1 10. The Image 
Acquisition Toolbox 230 also provides a set of M-file and MEX-file functions for controlling 
the data acquired from the data source 1 10. For example, the Image Acquisition Toolbox 230 
provides functions that enable users to preview the acquired data, and perform the analysis of 
the data on the fly. Image Acquisition Toolbox 230 also provides functions that logs data to 
disk, memory, or both. The Image Acquisition Toolbox 230 streams data into the MATLAB 
250 for further analysis and visualization of the data. 

One of skill in the art will appreciate that although the illustrative embodiment is 
implemented in computing environments, such as MATLAB 250, the present invention may 
be implemented in modeling and simulation environments including graphical environments, 
such as block diagram environments, and textual command line environments. The block 
diagram environments may include the environment provided by Simulink from The 
MathWorks, Inc. of Natick, MA. One of skill in the art will also appreciate that the present 
invention may be implemented in real time environments, such as Real Time Workshop from 
The MathWorks, Inc. of Natick, MA. 

FIGURE 3 is a block diagram of an exemplary computer system 300 suitable for 
practicing the illustrative embodiment of the present invention depicted in FIGURE 1. The 
computer system 300 includes a data source 1 10, a secondary memory 350, a primary 
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memory 360, a ^-processor 370, a monitor 380 and a keyboard/mouse 390. The ^-processor 
370 controls each component of the computer system 300 to run the software tools for object- 
oriented data transfer system properly. The computer system 300 receives through the 
keyboard/mouse 390 the control data necessary for transferring data from the data source 110, 
such as the control data for creating a data object. The computer system 300 may display in 
the monitor 380 the acquired data for users to preview the data. The monitor 380 may also 
display the result of the analysis and process of the data. The primary memory 360 fetches 
from the secondary memory 350 and provides to the ^-processor 370 the codes that need to be 
accessed quickly by the u-processor 370 to operate the computer system 300 and to run the 
software tools for transferring the data. The secondary memory 350 usually contains the 
application software tools. The secondary memory 350 includes, in particular, codes 320 for 
the data transfer unit 130, and codes 330 for the data sink objects 150-190. The secondary 
memory 350 also includes codes 340 for the data object encapsulating the data acquired from 
the data source 110. The computer system 300 may include network interfaces for 
communicating with other electronic devices through communication networks, such as 
Internet, intranet, LAN (Local Area Network), WAN (Wide Area Network) and MAN 
(Metropolitan Area Network). The communication interfaces may enable the computer 
system 300 to acquire data from data sources connected through communication networks. 

FIGURE 4 is a block diagram representation illustrating in more detail the application 
software tools implementing the data transfer system 100 in the illustrative embodiment of the 
present invention depicted in FIGURE 1 . The Image Acquisition Toolbox 230 provides a 
path for transferring data from a data source 1 10 to MATLAB 250. The Image Acquisition 
Toolbox 230 is interfaced with the data source 1 10 via the driver 420 of the data source 1 10. 
The driver 420 is of various types depending on the hardware of the data source 1 10 and is 
provided by the vendor of the data source 1 10 for the operation of the data source 1 10 by 



The Image Acquisition Toolbox 230 contains subcomponents including an acquisition 
engine 460 and adaptors 430-450. The acquisition engine 460 controls all of the logic for 
acquiring data from the data source 1 10, and storing and sending the acquired data to the 
MATLAB 250. While the acquisition engine 460 performs its own tasks, MATLAB 250 can 
also perform other tasks such as analyzing the acquired data. In other words, the acquisition 
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engine 460 and MATLAB 250 operate asynchronously. The adaptors 430-450 are 
components for communicating with a data source 1 10 via the driver 420 of the data source 
110. The adaptors 430-450 adapt the hardware driver 420 of the data source 1 10 to the Image 
Acquisition Toolbox 230. The adaptors 430-450 support specific vendors of the data source 
110. For example, an adaptor 430 supports for the data source devices produced by Data 
Translation, Inc. of Marlboro, Massachusetts, and an adaptor 440 for the data source devices 
produced by Matrox Electronic Systems, Ltd. of Quebec, Canada. In addition, the adaptor 
450 may support devices that provide a WDM (Windows Driver Model) or VFW (Video for 
Windows) driver including USB and Fire Wire (IEEE- 1394) cameras, as well as DCAM 
(IEEE- 1394 Digital Camera specification) compliant devices such as scientific cameras. The 
Image Acquisition Toolbox 230 will be described below in more detail with reference to 
FIGURE 5. 

The application software tools may be implemented in C programming language or 
object-oriented programming languages, such as C++, C# and Java, to realize the illustrative 
embodiment of the present invention. The object-oriented programming languages express a 
program as a set of objects, which communicate with each other to perform tasks. The objects 
are entities of a program that have properties and methods. The properties of an object are the 
data associated with the object and determine the attributes of the object. The methods of an 
object are operations (or functions) that the object can perform. One of skill in the art will 
appreciate that the software tools can be programmed using other programming languages, 
such as M-code, C-code and FORTRAN. The software tools written in C++, for example, can 
be compiled using the MEX command in MATLAB to make a file that is executable in the 
MATLAB environment. Alternatively, another embodiment of the present invention may 
provide a software tool written in C programming language or an object-oriented 
programming language, such as C++, C# and Java, that can be executed outside of MATLAB. 
The application software may also be incorporated into a deployable application by using a 
compiler for compiling the software application. 

FIGURE 5 is a block diagram representation illustrating in more detail the Image 
Acquisition Toolbox 230 in the illustrative embodiment of the present invention depicted in 
FIGURE 4. The Image Acquisition Toolbox 230 is divided into two layers including an 
adaptor layer 550 and an engine layer 560. The adaptor layer 550 includes an adaptor 430, a 
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frame kit 530 and a data object (ImaqFrame) 540. The adaptor 430 receives data from the 
data source 1 10 through its driver 420. The adaptor layer 550 provides a frame kit 530 that 
includes a library of functions for creating and managing the data object 540. The functions 
in the frame kit 530 are called by the adaptor 430 to create the data object 540 into which the 
data received from the data source 1 10 is encapsulated. Additional metadata, such as time 
stamp, memory information and index in a sequence, may be stored in the data object, which 
can be made accessible to users and data sink objects 150-190 for display, processing, 
memory logging, file logging, etc. When the data received from the data source 1 10 is 
encapsulated into the data object 540, memory for the data object 540 is automatically 
allocated by the frame kit 530. The memory is also de-allocated or reused automatically by 
the frame kit 530 when the data object 540 is no longer used by data sink objects. 

The data object 540 is an instance of a data object class. The data object class defines 
properties of the data objects that are its instances, and methods for creating and manipulating 
the instances. The properties of the data object 540 include the size, dimension (e.g., width, 
height, and number of bands in each image frame), color space (YUV, RGB, etc.), data type 
(Unsigned Int 8, Unit 16, etc.) of the data object 540. The data sink objects 150-190 may use 
the properties of the data object 540 to manipulate the data associated with the data object 
540. The properties of the data object 540 also include a counter that is described below in 
more detail with reference to FIGURE 9. One of skill in the art will appreciate that the data 
object can be extended to encapsulate any textual or binary data by inheriting from a data 
object class. 



Once the adaptor 430 calls the functions in the frame kit 530 to create the data object 
540, the functions return identification information of the data object 540, such as a pointer of 
the data object 540. The pointer of the data object 540 indicates the location of the data object 
540 in the memory of computer systems. By using the pointer of the data object 540, the 
memory for the data object 540 can be dynamically allocated and deallocated. FIGURE 7 is 
the flow chart summarizing an exemplary operation of the adaptor layer 550 in the illustrative 
embodiment of the present invention. First, data is received from the data source 1 10 (step 
710) and encapsulated into a data object 540 (step 730). The data object 540 is posted to the 
data server object 570 with the information identifying the data object 540 (step 730). 
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The engine layer 560 of the Image Acquisition Toolbox 230 includes a data server 
object 570 and data sink objects 150-190. The data server object 570 is responsible for 
transferring the data object 540 that is posted to the data server object 570. The data server 
object 570 has a list of data sink objects 150-190 that are registered with the data server object 
570. The data sink objects 150-190 that have interests in the data object 540 are registered 
with the data server object 570 to receive the identification information of the data object 540. 
The data server object 570 shares the identification information of the data object 540 with 
any number of data sink objects 150-190 that are registered with the data server object 570. 
The data object 540 is shared by the data sink objects 150-190 to avoid making extraneous 
copies of the data object 540 being transferred. 

The data sink objects 150-190 are consumers of the data object 540. The data sink 
objects 150-190 may be provided in the Image Acquisition Toolbox 230 or MATLAB 250. 
The tasks of the data sink objects 1 50-190 are application specific. For example, the data sink 
object 150 may enable users to preview the acquired data. Previewing the acquired data can 
be helpful to make sure that the data being acquired is satisfactory. For example, by looking at 
the preview window of the acquired data, users can verify that the lighting and focus of the 
data are correct. The data sink object 170 may store an indeterminate number of data objects 
in a container, for an indeterminate amount of time (i.e. data buffering), or until users choose 
to retrieve the data. The data sink object 190 may access the data associated with the data 
object 540 in order to analyze the data or log the data to a file. Each of the data sink objects 
150-190 dynamically determines how to process the data object 540 at execution time. The 
data sink objects 150-190 may perform their functions either on the thread of the data server 
object 570 or on a separate thread. 

In the engine layer 560, data sink listener objects can be created and registered with a 
data sink object. FIGURE 6 is a block diagram representation of data sink listener objects 
630-670 and a data sink object 610 in the illustrative embodiment of the present invention. 
The data sink listener objects 630-670 perform functions relating to the task performed by the 
data sink object 610. For example, if the data sink object 610 displays the preview window of 
the acquired data, the data sink listener objects 630-670 may display the absolute or relative 
acquisition time when the data is acquired. The data sink object 610 notifies the data sink 
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listener objects 630-670 when the state of the data sink object 610 changes to be active or 
inactive. The data sink object 610 also notifies the data sink listener objects 630-650 when 
the data sink object 610 is updated with a new data object. If the data sink object 610 is 
deleted, the data sink listener objects 630-650 registered with the data sink object 610 are 
automatically removed. 

FIGURE 8 is the flow chart showing the operation of the engine layer 560 in the 
illustrative embodiment of the present invention. The data sink object 150 is registered with 
the data server object 570 to receive the pointer information of the data object 540 (step 810). 
The data server object 570 shares the pointer information of the data object 540 with the data 
sink objects 150-190 that are registered with the data server object 570 (step 830). The data 
sink objects 150-190 can subsequently access the data object 540 with the pointer information 
of the data object 540 at execution time (step 850). Consequently, the data object 540 is 
shared by the multiple data sink objects 150-190, which prevents extraneous copies of the 
data being transferred. 

FIGURE 9 is the flow chart showing the operation of the counter of the data object 
540 in the illustrative embodiment of the present invention. The counter is provided for the 
data object 540 to indicate the number of data sink objects 150-190 that are currently utilizing 
the data object 540 (step 910). The counter is automatically increased when the identification 
information of the data object 540, such as the pointer of the data object 540 in the memory of 
a computer system, is provided to the data sink objects 150-190, and is automatically 
decreased when each of the data sink objects 150-190 no longer needs to access the data 
associated with the data object 540 (step 930). If the counter is decreased to zero (step 950), 
which indicates that the data object 540 is no longer needed by the data sink objects 150-190, 
the data object 540 is removed from the memory of the computer system (step 970). 
Alternatively, if the counter is decreased to zero, the data object 540 is stored in a separate 
location of the memory for a future use (step 970). 

FIGURE 9a is the flow chart showing the operation of the illustrative embodiment of 
the present invention in connection with the data sink counter of the data object 540 described 
in FIGURE 9. When a data object is created by a data object creator (FrameKit), the data 
object is posted to a data server object (step 980). If no data sink object is registered with the 
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data server object (step 981), the data object is deleted (step 982). If data sink objects are 
registered with the data server object (step 981), the data object is instructed to increment its 
data sink counter (step 983). Information identifying the data object, such as the pointer of 
the data object in a memory, is provided to each of the data sink objects (step 984). Each of 
the data sink objects accesses the data object using the identification information of the data 
object (step 985). When a data sink object no loner needs to access the data object, data 
object is instructed to decrement the data sink object (step 986). If the counter is decreased to 
zero (step 987), the data object is removed from the memory of the computer system or 
alternatively, the data object is stored in a separate location of the memory (step 988). 

In summary, the data acquired from a data source is encapsulated into a data object, 
which is subsequently posted to a data server object with the pointer information of the data 
object in the memory of a computer system. The data server object shares the pointer 
information of the data object with the data sink objects that are registered with the data server 
object. The data object shared by the multiple data sink objects prevents extraneous copies of 
the acquired data provided to each of the data sink objects. The data object is provided with a 
counter indicating the number of data sink objects that use the data object. The data transfer 
systems of the present invention remove the data object if the counter indicates that the data 
object is no longer used by the data sink objects. As a result, the present invention efficiently 
uses the memory space of the computer system. 

It is apparent that there has been provided, in accordance with the present invention, 
object-oriented data transfer methods and systems. While this invention has been described in 
conjunction with illustrative embodiments thereof, it is evident that many alternatives, 
modifications, and variations will be apparent to those skilled in the art. For example, the 
present invention can be applied to any data transfer system including a data transfer system 
that transfers data from application software tools of computer systems to devices coupled to 
the computer systems. Accordingly, it is intended to embrace all such alternatives, 
modifications and variations that fall within the spirit and broad scope of the appended claims. 



